Web Survey Bibliography
Relevance & Research Question
When developing web-based course evaluation tools (for evaluating teaching e.g. in university or secondary schools), researchers and practitioners put much effort into reaching high psychometric properties of the instruments, realizing high participation rates, suitable and useful reports of the results, and the drawing of consequences (see Thielsch & Hirschfeld, 2011). However, there are three more vital aspects not to be overlooked, especially when using technology to aid collection, processing, and presentation of data: privacy, data security, and the ethical dimension of our actions. To account for these aspects is critical not only from a judicial point of view (European Union Data Protection Directive, 95/46/EC or, for Germany, Bundesdatenschutzgesetz, BDSG); considering them will arguably also foster acceptance of course evaluations among evaluators and evaluatees. This presentation therefore aims at discussing issues of privacy, data security and its ethical dimension when conducting online course evaluations.
Methods & Data
A review of the literature on the mentioned issues of course evaluations was conducted and paralleled to existing practice. Additional theoretical and practical aspects were examined. The following are key aspects being discussed: (1) carefully selecting (and limiting) the variables to assess; (2) securing assessment and storage of data via access control and encryption; (3) anonymized or pseudonymized archiving of data; (4) ethical aspects such as using non-reactive data and reporting of negative results.
Results
Online course evaluations show potential for very high data quality and benefits over traditional paper-pencil evaluations, in part due to the facilitated way to collect and process large data sets. However, the risks accompanying these facilitations are discussed, and recommendations for researchers and practitioners are given on how to control or even avoid them altogether.
Added Value
The study raises awareness for aspects of course evaluations that are often taken for granted or neglected, but may endanger data integrity as well as acceptance when not paid attention to. The study gives recommendations for conductors of web-based course evaluations on how to handle these aspects.
GOR Homepage (abstract) / (presentation)
Web survey bibliography (96)
- Examining Factors Impacting Online Survey Response Ratesin Educational Research: Perceptions of Graduate...; 2017; Saleh, A.; Bista, K.
- Using Mixed Methods to Research the Professional Development Needs of English Teacher Educators in PCET...; 2017; Eliahoo, R.
- Why Do Web Surveys Take Longer on Smartphones?; 2016; Couper, M. P.; J. J.Peterson, G. J.
- The impact of visual design and response formats on data quality in a web survey of MOOC students; 2016; Maloshonok, N.; Terentev, E.
- Reminder Effect and Data Usability on Web Questionnaire Survey for University Students; 2016; Oishi, T.; Mori, M.; Takata, E.
- Investigating respondent multitasking in web surveys using paradata; 2016; Sendelbah, A.; Vehovar, V.; Slavec, A.; Petrovcic, A.
- Exploring Factors in Contributing Student Progress in the Open University; 2016; Arifin, M. H.
- Mode System Effects in an Online Panel Study: Comparing a Probability-based Online Panel with two Face...; 2015; Struminskaya, B.; De Leeuw, E. D.; Kaczmirek, L.
- Response Effects of Prenotification, Prepaid Cash, Prepaid Vouchers, and Postpaid Vouchers: An Experimental...; 2015; van Veen, F.; Goeritz, A.; Sattler, S.
- Calendar Instruments in Retrospective Web Surveys; 2015; Glasner, T.; van der Vaart, W.; Dijkstra, W.
- Cognitive Testing of Survey Translations: Does Respondent Language Proficiency Matter?; 2015; Schoua-Glusberg, A.; Park, H.; Meyer, M.; Goerman, P. L.; Sha, M.
- Nannies' Knowledge, Attitude, and Management of Food Allergies of Children: An Online Survey; 2015; Greiwe, J. C., Pazheri, F., Schroer, B.
- Is Vague Valid? The Comparative Predictive Validity of Vague Quantifiers and Numeric Response Options...; 2014; Al Baghal, T.
- Improving Survey Response Rates in Online Panels Effects of Low-Cost Incentives and Cost-Free Text Appeal...; 2014; Pedersen, M. J., Nielsen, C. V.
- The New Majority: How Will Latino Youth Succeed in the Context of Low Educational Expectations and Assumptions...; 2014; Gomez, C. A., Villasenor, E., Mann, E. S., Mandic, C. G., Valladares, E. S., Mercado, V., et al.
- Testing if Healthy Perfectionism Enhances Academic Achievement in Australian Secondary School Students...; 2014; Thorpe, E., Nettelbeck, T.
- Assessing Within-Household Selection Methods in Household Mail Surveys; 2014; Olson, K., Stange, M., Smyth, J. D.
- Web-based Emergency Department Patient Satisfaction Surveys May Introduce Potential for Bias; 2014; Broadwater-Hollifield, C., Fair, J., Podolsky, S., et al.
- Undisclosed Privacy: The Effect of Privacy Rights Design on Response Rates; 2014; Haer, R., Meidert, N.
- Dropout Rates and Response Times of an Occupation Search Tree in a Web Survey; 2014; Tijdens, K. G.
- Students First Choice – the influence of mobile mode on results; 2014; Maxl, E.
- The relationships among nurses' job characteristics and attitudes toward web-based continuing learning...; 2013; Chiu, Y.-L., Tsai, C.-C., Fan Chiang, C.-Y.
- Evaluating Arts-Based Cancer Education Using an Internet Survey among Alaska Community Health Workers...; 2013; Cueva, M., Cueva, K., Dignan, M., Lanier, A., Kuhnley, R.
- Education in the Responsible Conduct of Research in Psychology: Methods and Scope; 2013; DiLorenzo, T. A., Becker-Fiegeles, J., Gibelman, M.
- Intra-individual variation of extreme response style in mixed-mode panel studies; 2013; Aichholzer, J.
- Knowledge of palliative care: An online survey; 2013; Al Qadire, M.
- Identifying the Research Information Needs of the Racing and Breeding Industries in New Zealand: Results...; 2013; Bolwell, C., Gray, Da., Reid, Ja.
- Educational use of smart phone technology: A survey of mobile phone application use by undergraduate...; 2013; Bomhold, C. R.
- Media Commons: the process and value of centralizing services; 2013; Mestre, L. S.
- Dialogistic Presence on Community College Websites in Nine Megastates; 2013; Shadinger, D.
- Adjusting for bias in a mixed-mode CAWI survey on University students ; 2013; Clerici, R., Giraldo, A.
- An imputation approach for analyzing mixed-mode surveys; 2013; Kim, J. K., Park, Se., Kim, S. Y.
- A walking exercise on a tightrope: trying to balance coverage, probabilistic sampling and the costs...; 2013; Poggio, T.
- Validity of Measuring Educational Attainment - Education and Value Orientation in the European Values...; 2013; Ortmanns, V.
- Educational attainment in cross-national surveys: instrument design, data collection, harmonisation...; 2013; Schneider, S.
- Eliminate Item Non-Response: The Effect of Forcing Respondents to Answer in Web Surveys; 2013; Leach, L. M.
- Building a History: Collecting Comprehensive Employment Data in a Web-Based, Multi-Mode Survey; 2013; Cominole, M., Bennett, C., Caves, L.
- Use of Drag-and-Drop Rating Scales in Web Surveys and Its Effect on Survey Reports and Data Quality; 2013; Kunz, T.
- The Impact on Web Survey Drop-Out Rates of Page Number Progress Indicators Used Throughout, Near the...; 2013; Walston, J. T., Cunningham, B., Medway, R.
- Utilizing the Web in a Multi-Mode Survey; 2013; Venkataraman, L.
- Speed (necessarily) doesn't kill: A new way to detect survey satisficing; 2013; Garland, P., Chen, K., Epstein, J., Suh, A.
- Using interactive feedback to enhance response quality in Web surveys. The case of open-ended questions...; 2013; Emde, M., Fuchs, M.
- Reducing Response Order Effects in Check-All-That-Apply Questions by Use of Dynamic Tooltip Instructions...; 2013; Kunz, T., Fuchs, M.
- Ethics, privacy and data security in web-based course evaluation; 2013; Salaschek, M., Meese, C., Thielsch, M.
- Medical students’ exposure to Urology in the undergraduate curriculum, a web based survey; 2012; Derbyshire, L. F., O’Flynn, K. J.
- Social research in online context: methodological reflections on web surveys from a case study; 2012; Pandolfini, V.
- What can be said about quality in the Central Population Register based on a self-completion survey...; 2012; Falnes-Dalheim, E., Pedersen, H. E.
- Boosting Web pick-up Rates by referring to Compliance Principles ; 2012; Falnes-Dalheim, E., Haraldsen, G., Sundvoll, A.
- Ebook readings jumps, print book reading declines; 2012; Rainie, L., Duggan, M.
- Prenotification, Incentives, and Survey Modality: An Experimental Test of Methods to Increase Survey...; 2012; Tepper, J. R., Jacob, B.